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Abstract 

The question of recurrence and transience of branching Markov chains is more 
subtle than for ordinary Markov chains; they can be classified in transience, weak 
recurrence, and strong recurrence. We review criteria for transience and weak re- 
currence and give several new conditions for weak recurrence and strong recurrence. 
These conditions make a unified treatment of known and new examples possible and 
provide enough information to distinguish between weak and strong recurrence. This 
represents a step towards a general classification of branching Markov chains. In par- 
ticular, we show that in homogeneous cases weak recurrence and strong recurrence 
coincide. Furthermore, we discuss the generalization of positive and null recurrence 
to branching Markov chains and show that branching random walks on Z are either 
transient or positive recurrent. 
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1 Introduction 



A branching Markov chain (BMC) {X, P, fi) is a system of particles in discrete time on 
a discrete state space X. The process starts with one particle in some starting position 
X e X. At each time particles split up in offspring particles independently according to 
some probability distributions {p.{x))xizx- The new particles then move independently 
according to some irreducible Markov chain {X, P) with transition probabilities P. 
Processes of this type are studied in various articles with different notations and 
variations of the model. 

Ordinary Markov chains are either transient or recurrent, i.e., the starting position 
is either visited a finite or an infinite number of times. This — 1-law does not hold 
for branching Markov chains in general, compare with [2], [ID], and [20]. Let a{x) be 
the probability that starting the BMC in x the state x is visited an infinite number of 
times by some particles. We can classify the BMC in transient {a{x) = for all x), 
weakly recurrent (0 < a{x) < 1 for all x), and strongly recurrent (a{x) = 1 for all x). 
In cases where we do not want to distinguish between weak and strong recurrence we 
just say that the process is recurrent. Effects of this type occur also in a varied model 
of BMC in which the branching is governed by a fixed tree, compare with |2j for more 
details on Markov chains indexed by trees. 

Let m(x) be the mean of the offspring distribution /i(a:). If m{x) = m for all x 
there is a nice and general criterion for transience and recurrence: the BMC {X, P, ^) 
is transient if and only if to < l/p{P), where p{P) is the spectral radius of the 
underlying Markov chain {X,P). Observe that the type of the process depends only 
on two characteristics, m and p{P), of the process. We give several description of 
the spectral radius p{P). These description are useful to give several different proofs 
for the above criterion and offer various possibilities to decide whether a process is 
transient or recurrent. 

Another purpose of this paper is to review and to continue the work of f2], [8], [TO], 
[l2],[I3,[l2],[IH],[2l],[2n],[23],[23,[26],and[28]. We present a unifying description 
and give new conditions for weak and strong recurrence. Our results suggest that the 
type of the process only depends on the mean number of offspring and some variation 
of the spectral radius of the underlying Markov chain, too. 

A useful observation concerning the different types is that transience / recurrence 
is sensitive to local changes of the underlying process but criteria for strong recurrence 
have to contain global information of the process. This fact is exploited by the idea 
of seeds, finite regions of the process that may produce an infinite number of particles 
independently of the rest of the process. Eventually, infinitely many particles leave this 
finite regions and return to the starting position. Hence, the BMC is recurrent. While 
the existence of one such seed already implies recurrence, we need sufficiently many 
good seeds to guarantee strong recurrence, compare with Section [3l In homogeneous 
cases, where local properties become global, recurrence and strong recurrence coincide, 
compare with Subsection 13.21 

In Section [2] we recall some facts about Markov chains. Green functions, and the 
corresponding spectral radius that are crucial for our further development. In par- 
ticular, we give several description of the spectral radius of a Markov chain, e.g. in 
terms of power series, superharmonic functions, Perron-Frobenius eigenvalues, and 
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rate function of large deviations. In Subsection 12.21 we define the model of BMC for- 
mally, recall the classification results for transience and recurrence of [lO] and [20] . 
and give concrete examples in Subsection 12.31 

In Section [3] we first give general conditions for strong recurrence, see Subsection 
I3.H and show that in homogeneous cases recurrence and strong recurrence coincide, 
see Subsection 13.21 where we prove known (Theorems 13.71 and 13. 9p and new results 
(Theorems 13.81 and 13.111 as well as Subsection 13.2. Sp with a unified method. We then 
discuss, see Subsections 13.31 several conditions for strong recurrence that, while not 
leading to a complete classification in general, work well in concrete situations and 
offer a toolbox to handle further concrete problems. In particular, there is a second 
critical value that divides the weakly and strongly recurrent phase. We want to point 
out that at the second critical value the process may be either strongly or weakly 
recurrent, compare with Theorem 13.141 In order to develop a complete classification 
we study BMC on graphs in Subsection 13.3.21 and give conjectures in Subsection 13.41 

In Section [4] we generalize the concept of positive and null recurrence to BMC 
and give conditions for positive recurrence in terms of a functional equation, Theorem 
14.41 that fits in the context of Theorems 12.111 and 13.21 and can be seen as the natu- 
ral generalization of the criterion of Foster for positive recurrence of Markov chains. 
Eventually, we conclude in showing that homogeneous branching Markov chains on Z 
with bounded jumps are either transient or positive recurrent, compare with Theorem 
Ol 

2 Preliminaries 
2.1 Markov chains 

A Markov chain (X, P) is defined by a countable state space X and transition proba- 
bilities P = {p{x, y))^ ■ elements p(x, y) of P define the probability of moving 
from x to y in one step. As usual, let Xn denote the position of the Markov chain 
at time n. The transition operator P can be interpreted as a (countable) stochastic 
matrix, so that, on the one hand, p("^(x, y) is the (x, ?/)-entry of the matrix power P" 
and, on the other hand, we have that p^"-'(a;,?/) = PxiXn = y) is the probability to 
get from a; to y in n steps. We set P° = /, the identity matrix over X. Throughout 
this paper we assume that the state space is infinite and that the transition opera- 
tor P is irreducible, i.e., for every pair x,y € X there exists some fc € N such that 
p^^\x,y) > 0. 

Markov chains are related to random walks on graphs. So let us recall some basic 
standard notations of graphs. A (directed) graph G = (V, E) consists of a finite or 
countable set of vertices V and an adjacency relation ~ that defines the set of edges 
E C VxV. A path from a vertex x to some vertex y is a sequence x = xo,xi, . . . ,Xn = y 
with Xi ^ Xi+i for all < « < n. The number n is the length of the path. A graph is 
(strongly) connected if every ordered pair of vertices is joined by a path. The usual 
graph distance d{x, y) is the minimum among the length of all paths from x to y. 
A vertex y is called a neighbor oi x \i x ^ y. The degree deg{x) of a vertex x is 
the numbers of its neighbors. A graph is called locally finite if deg{x) is finite for 
all vertices x. We say a graph G has bounded geometry if deg{-) is bounded and is 
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M-regular if all vertices have degree M. 

Every Markov chain {X,P) defines a graph G — {V,E), with a set of vertices 
V = X and a set of edges E := {{x,y) : p{x,y) > x,y £ X}. It is clear that 
a Markov chain is irreducible if and only if its corresponding graph is connected. 
If the transition probabilities of the Markov chain are in some kind adapted to the 
structure of G, we shall speak of a random walk on G with transition probabilities P. 
We shall call a Markov chain on a graph with symmetric adjacency relation a simple 
random walk (SRW) if the walker chooses every neighbor with the same probability, 
i.e., p{x,y) — l/deg{x) for x ^ y and otherwise. 

We recall the Green function and the spectral radius of an irreducible Markov 
chain. These two characteristics will be crucial for our further development, compare 
with §1 in [29] for proofs and more. 

Definition 2.1. The Green function of {X,P) is the power series 

oo 

G{x,y\z) := y)z", x,y e X, z G C. 

We write G{x,x) for G(a;,a;|l). 

Observe, that, due to the irreducibility, G{x,y\z) either converges for all x,y E X 
or diverges for all x,y £ X. Therefore, we can define R as the finite convergence radius 
of the series G{x, y\z) and call l/R the spectral radius of the Markov chain. 

Definition 2.2. The spectral radius of {X,P) is defined as 

p{P) :=limsup(p(")(x,y))'^" e (0,1]. (2.1) 

We denote p{G) the spectral radius of the SRW on the graph G. 
Lemma 2.3. We have 

p(")(a;,a;) < p(P)", and lim fp^"'^) (a;, a;) V^"'' = p(P), 

n — >QO \ / 

where d := d{P) :— gcd{n : p^^^'>{x,x) > Va;} is the period of P. 

If X and P are finite, the spectral radius of p{P) becomes the largest, in absolute 
value, eigenvalue of the matrix P and equals 1. The spectral radius of a Markov chain 
with infinite state space can be approximated with spectral radii of finite sub-stochastic 
matrices. To this end we consider (general) finite nonnegative matrices Q. A matrix 
Q = (Qij)i,jeM™x" with nonnegative entries is called irreducible if for any pair of 
indices i,j we have Q™{i,j) > for some to e N. The well-known Perron-Frobenius 
Theorem states (e.g. Theorem 3.1.1 in [7]), among other things, that Q possesses a 
largest, in absolute value, real eigenvalue p{Q). Furthermore, we have (e.g. with part 
(e) of Theorem 3.1.1 in 0) 

p{Q) = limsup(g"(i,i))^/" VI < i < iV. 

n — ^CJO 

Remark 2.4. If Q is a symmetric matrix with p{Q) < oo then Q acts on l'^{X) as a 
bounded linear operator with norm \\Q\\ = p{Q). The same holds true for reversible 
Markov chains {X, P) with P acting on some appropriate Hilbert space. 
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Now, let us consider an infinite irreducible Markov chain {X,P). A subset Y C X 
is called irreducible if the sub-stochastic operator 

Py = {pY{x,y))x,yeY 

defined by py{x, y) := p{x, y) for all x,y GY is irreducible. 
It is straightforward to show the next characterization. 

Lemma 2.5. Let {X,P) be an irreducible Markov chain. Then, 

p(P) = supp(Py), (2.2) 

Y 

where the supremum is over finite and irreducible subsets Y C X. Furthermore, 
p{Pf)<p{Pg) ifFcG. 

For finite irreducible matrices Q the spectral radius as defined in l|2.ip equals the 
largest eigenvalue of Q. This does not longer hold true for general infinite irreducible 
transition kernels P, compare with [27], since the existence of a Perron- Frobenius 
eigenvalue can not be guaranteed. Nevertheless, the transition operator P acts on 
functions / : X ^ M by 

P/(x) :-^p(a;,y)/(y), (2.3) 
y 

where we assume that P|/| < oo. It turns out that the spectral radius p{P) can be 
characterized in terms of i-superharmonic functions. 

Definition 2.6. Fix i > 0. A i-superharmonic function is a function / : X ^ R 
satisfying 

Pf{x) < t ■ fix) Vx e X. 

We obtain the following (well-)known characterization of the spectral radius in 
terms of i-superharmonic functions, e.g. compare with §7 in |29j . 

Lemma 2.7. 

p{P) = mm{t > : 3 /(•) > such that Pf < tf} 

We can express the spectral radius in terms of the rate function /(•) of a large 
deviation principle (LDP). Let us assume that a LDP holds for the distance, i.e., 

lim inf - log P„ ( eo] > - inf 1(a) , 

ji^oo n \ n J aeo 

lim sup - log P„ ( ^i^^JlA ec] < - inf I (a) , 

Ti— oo n \ n J aec 

for all open sets O C M and all closed sets C C M. Furthermore, we assume eUipticity, 
i.e., that there is some constant c > such that p{x,y) > c ■ l{p{x,y) > 0} for all 
x,y e X. 

We do not claim to be the first who make the following observation that is quite in- 
tuitive since LDP's for Markov chains are closely linked with Perron- Frobenius theory 
for irreducible matrices. 
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Lemma 2.8. Let {X,P) be an irreducible Markov chain with p{x,y) > c-l{p{x,y) > 
0} for some constant c > 0. Assume furthermore that a LDP holds for the distance 
with rate function /(•), then 

-logp(P)=/(0). (2.4) 

Proof. We have 

-1(0) = lim lim ilogPo ( ^^^^ < e] 

e^O n^oo n \ n J 

> lim sup - log Po {Xn = o) = log . 

n— ^oo 

For the converse we use our assumption: p{x,y) > c- l{p{x,y) > 0} for some c > 0. 
With < £ < 1 we obtain 

P^'^Ko, O) > ¥o {d{X^n{l-e)] , O) < [n^J ) C^^J . 

Therefore, 



n 



< ^log(p(")(o,o)c-L"^J)) 

= log(p(")(o,o))'^"-Mlogc. 



Hence, for all < £ < 1 



-/(O) < lim -\og¥o < /"^^ ] < logp-£logc. 

Now, letting £ ^ finishes the proof. □ 

2.2 Branching Markov chains 

A branching Markov chain (BMC) {X, P, jj) consists of two dynamics on the state 
space X: branching, (/u(a;))xex, and movement, P. Here 

/i(x) = (Aife(3:))fc>i 

is a sequence of nonnegative numbers satisfying 



oo 



IJ-k{x) = 1 and m{x) := kfik{x) < oo, 



A)=l fe=i 

and ^fe(x) is the probability that a particle in x splits up in k particles. The movement 
of the particles is governed through an irreducible and infinite Markov chain {X, P) . 
Note that we always assume that each particle has at least one offspring, i.e., (jlq = 0, 
and hence the process survives forever. Similar results can be obtained by conditioning 
on the survival of the branching process. 

The BMC is defined as follows. At time we start with one particle in an arbitrary 
starting position a; e X. At time 1 this particle splits up in k offspring particles with 
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probability ^k(x)- Still at time n = 1, these k offspring particles then move indepen- 
dently according to the Markov chain [X,P). The process is defined inductively: At 
each time each particle in position x splits up according to and the offspring 

particles move according to {X,P). At any time, all particles move and branch in- 
dependently of the other particles and the previous history of the process. If the 
underlying Markov chain is a random walk on a graph G and the branching distribu- 
tions are adapted to G we shall also speak of a branching random walk (BRW). In 
the case where the underlying random walk is a simple random walk on a graph G we 
denote the process {G,^). 

We introduce the following notations in order to describe the process. Let r]{n) be 
the total number of particles at time n and let Xi{n) denote the position of the ith 
particle at time n. Denote Vx{-) = IP(-|a;i(0) = a;) the probability measure for a BMC 
started with one particle in x. A BMC can be viewed as a Markov chain on the big 
state space 



Clearly, this Markov chain on X is transient if m{x) > 1 for some x G X. A priori 
it is not clear in which sense transience and recurrence of Markov chains can be 
generalized to BMC. One possibility is to say a BMC is recurrent if with probability 
1 at least one particle returns to the starting position. This approach was followed 
for example in [T^. We choose a different one, e.g. compare with [2], [10], and ^20], 
since this approach offers a finer partition in recurrence and transience, and gives 
interesting generaHzations of equivalent conditions for transience of (nonbranching) 
Markov chains, compare with Theorem 12. Ill 

Definition 2.9. Let 



be the probability that x is visited an infinite number of times, given the process starts 
in X with one particle. A BMC is called transient if a{x) = for some all) a; G X, 
weakly recurrent if < a (a;) < 1 for some all) x G X, and strongly recurrent if 
a{x) = 1 for some {-i^ all) x G X. We write a = if a{x) = for all x G X and a > 
and a = 1, respectively. We call a BMC recurrent if it is not transient. 

Definition 12.91 is justified through the next result. 

Lemma 2.10. We have that a{x) = 0, a(x) > 0, and a{x) = 1 either hold for all or 

none x G X. 

Proof. Let x,y G X. Due to irreducibility and the independence of branching and 
movement we have that 



X XUX^UX^ 



u ... 




(2.5) 
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is equivalent to 

/ oo v{n) \ 

\n=l i=l J = I 

Hence, it suffices to show that 

(oo nin) oo >)(n) \ 

= x} = oo and ^^'■i'^) = y} < oo =0. (2.6) 

n— 1 i—1 n—1 i—1 j 

We follow the line of the proof of Lemma 3.3 in [2]. Since {X^P) is irreducible we 
have p^'-\x, y) ~ S > for some I e N. Let N,M eN. The probability that there are 
times M < ni, . . . ,nN with rij-i + 1 < nj for all 1 < j < such that Xi{nj) = x for 
some 1 < i < rj{nj) for all j but Xi{n) ^ y for all n > M and all 1 < i < 77(71) is at 
most (1 — 5)^ . Letting — > 00, this yields 

00 ri(n-) 00 >)(n) 

l{2:j(77) a;} = 00 and ^ ^ l{xi(n) = j/} = 

71—1 i— 1 n—M i—1 

Let Am be the event in the last formula. Notice that 

{CO- »)(") 00 
l{a;j(n) ^ x} ^ 00 and ^ ^ l{a;i(7T,) ^ y} < 00 
n=l i=l n=l i=l 

This proves the claim. □ 

In analogy to [l8j, see also the superposition principle in [12], we introduce the 
following modified version of BMC. We fix some position o € X, which we denote the 
origin of X. The new process is like the original BMC at time n — I, but is different 
for 71 > 1. After the first time step we conceive the origin as freezing: if a particle 
reaches the origin, it stays there forever and stops splitting up. We denote this new 
process with BMC*. The process BMC* is analogous to the original process BMC 
except that p{o, o) — \, p{o, x) = \fx o and /^i(o) = 1 from the second time step 
on. Let 77(71, x) be the number of particles at position x at time 7i. We define the 
random variable iy{o) as 

i'(o) := lim 77(71, o) S {0, 1, . . .} U {00}. 

n — >OG 

We write Kxi^{o) for the expectation of i^(o) given that a;i(0) = x. Note that our 
notation of ri{n,o) and iy{o) is different from the one in [lOj. Since the choice of the 
origin may affect the behavior of the BMC*, we keep track of the dependence of the 
variables 77 and i' on the choice of the origin and write 77(71, o) and i'{o). Furthermore, 
our definition of the process BMC* differs from the one given in [l8j: in our definition, 
the origin is not absorbing at time 71 = 1. 

The Green function G{x,x\m) at z = m gives the expected number of particles 
that visits a; of a BMC with constant mean offspring ?7i = 77i(a;) started in x. Due to 
this interpretation, G{x, y\m) < 00 implies transience of a BMC with constant mean 
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offspring m. While in some cases, e.g. random walk on homogeneous trees [12], the 
converse is true, it does not hold in general, compare with Remark [HTSl It turns out 
that another generating function is decisive for transience. Let 

Ty :^ min{X„ = y} 

n>l 

be the time of the first return to y and 

oo 

U{x,y\z) :=^P,(Ty = n)z" 

n=l 

its corresponding generating function. Due to the definition of the process BMC* we 
have the useful identity 

E^i^{y) = U{x,y\m) 

for a BMC with constant mean offspring m. Furthermore, the equality offers a proba- 
bilistic interpretation for the generating function U{x, y\z) with z > 1. The generating 
functions G and U are naturally connected through 

G{x,x\z) = -- 

1 ~ U(x, x\z) 

and hence one can show that 



p(P) max{z > : C/(x,a;|z) < 1}. (2.7) 

The next Theorem, due to [20j, gives several sufficient and necessary conditions 
for transience. Notice that the expected number of particles visiting x the first time 
in their ancestry line, i.e., Exi^{x), takes the role of the Green function in the theory 
of Markov chains and that the criterion of transience in terms of the existence of 
nonconstant superharmonic functions becomes {Hi). 

Theorem 2.11. A BMC {X, P, ^) with m{y) > 1 for some y is transient if and only 
if the three equivalent conditions hold: 

(i) Eoi^(o) < 1 for some all) o e X. 

(a) Ea;i^(o) < oo for all x,o £ X. 

(Hi) There exists a strictly positive function /(•) such that 

Pfix)<^ yxex. 

m(x) 

In particular if the mean offspring is constant, i.e., m{x) — m \fx G X, we have, 
due to Lemma [277t the following result of [10]. Observe that in this case we can speak 
about a critical behaviour. 

Theorem 2.12. The BMC {X, P, ^) with constant mean offspring m > 1 is transient 
if and only if m < l/p{P). 
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Theorem 12.121 follows directly from Lemma [2.71 and part (in) of Theorem 12.111 
Another way, compare with [30], to see Theorem 12.121 is combining Theorem 12.111 (i) 
and the fact that p{P) = max{z > : U{x,x\z) < 1} (see Equation l|2.7p ) and 
conclude with Ej.i^(y) = U{x,y\m). We give a direct proof, without using the abstract 
arguments of Lemma 12.71 or Equation (|2.7p , since the arguments used are helpful to 
understand the reasonings in the remainder of the paper. 

Proof. The case m < l/p{P) is clear, since G{x,x\m) < oo imphes transience. To 
show that m > l/p{P) imphes recurrence we compare the original BMC with an 
embedded process and prove that this process with fewer particles is recurrent. We 
start the BMC in o S X. We know from the hypothesis and the definition of p{P) 
that there exists a k = k{o) such that 

We construct the embedded process (^i)i>o by observing the BMC only at times 
k, 2k, 3k, . . . and by neglecting ah the particles not being in position o at these times. 
Let be the number of particles of the new process in o at time ik. The process {£,i)i>o 
is a Galton- Watson process with mean p'^'^\o, o) ■ > 1, thus survives with positive 
probability. Eventually, the origin is hit infinitely often with positive probability. 

In order to prove transience at the critical value m = 1/ p{P), we use a continuity 
argument to show that the subset {m : {X, P, p) is recurrent} C K is open. In other 
words for any recurrent BMC with mean offspring m there exists some e > such 
that the BMC with mean offspring m — e is still recurrent and hence the critical BMC 
must be transient. So assume the BMC to be recurrent. Due to Theorem 12.111 (i) 
there exists some k such that Eo?7(fc, o) > 1. We define an embedded Galton- Watson 
process (Ci)i>o- We start a BMC* with origin o with one particle in o. Let ^'i be the 
particles that are the first particles in their ancestry fine to return to o before time 
k. We define '^i inductively as the number of particles that have an ancestor in 
and are the first in the ancestry line of this ancestor to return to o in at most k time 
steps. Clearly Co := 1 and Q := i > 1, defines a supercritical Galton- Watson 

process since E(i = Eo77(fc,o) > 1. Furthermore, E(i — Eori{k,o) and 

ExTiik, 6) — m ■ '^^p{x, y)Eyri{k — l,o) + m ■ p{x, o). 

Now, it is easy to see that EC,i is continuous in m. Eventually, for e > sufficiently 
small the BMC with mean offspring to — e is still recurrent. 

□ 

Remark 2.13. Theorem 12.121 imphes that G[x,x\m) < oo is equivalent to transience 
of the process if and only if G{x, x\l/ p{P)) < co, i.e., the underlying Markov chain is 
p-transient. 

Remark 2.14. The fact that mp{P) > 1 implies the recurrence of the BMC can be 
also seen by dint of the interpretation as a general branching process and Lemma [2751 
Due to the latter there exists a finite and irreducible Y such that mp^Py) > 1. Now, 
let us consider only particles in Y and neglect the particles leaving Y. This defines a 
supercritical multi-type Galton- Watson process with first moments m-Py that survives 
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with positive probability, compare with Chapter V in p], and hence a{x) > 0. Finite 
regions as Y, that may produce an infinite number of particles without help from 
outside, are referred to as seeds. Note that in [6l| regions of these kind are called 
recurrent seeds. 



2.3 Examples 

Example 2.15. Consider the random walk on Z'*, d e N. Let e Z"* with {ei)j = Sij 
for d> 1, and define transition probabilities P by 

p{x, X + Bi) ^ , p{x, X — Ci) — pY such that 

d d 
i=l 1=1 

and such that P is irreducible. Take branching distributions with constant mean 
offspring m. We calculate, using for example large deviation estimates (compare with 
Lemma l2.2p : 

d I 

p(P)=2^^p+p-. 

i=l 

Hence, the corresponding BMC is transient if and only if 

m< 1/ (^Y^^P^^ ■ 

In particular, the BRW (Z'', /i) with constant mean offspring is recurrent if m > 1. 

Example 2.16. We consider an irreducible symmetric random walk on a finitely gen- 
erated group and constant mean offspring m. We can classify groups in amenable or 
nonamenable using branching random walks: a finitely generated group G is amenable 
if and only if every BRW on G with constant mean offspring m > 1 is recurrent. This 
statement is a variation of Proposition 1.5 in where tree- indexed Markov chains 
are considered. To proof it, we merely need to combine Theorem 12.121 with the well- 
known result of Kesten stating that every irreducible and symmetric Random Walk 
on a finitely generated group G has spectral radius 1 if and only if G is amenable, e.g. 
compare with Corollary 12.5 in [29] . 

Example 2.17. Let {X,P) be the SRW on the regular tree Tm- We have p{P) — 
p(Tm) = ^"^W^ (compare with Lemma 1.24 in [29]). The BMC (Tm, with constant 
offspring distribution is transient if and only if 

M 

m < 



2VM- 1 



Example 2.18. We consider the example of Section 5 in [5] on Z with binary branching, 
i.e., iJ,2{x) — 1 for all a; S Z. The transition probabilities are p(l,0) ~ p(l,2) = 
1/8, p(l,l) =3/4 and 

p{x, a; + 1) = 1 — p{x, a; — 1) = x ^ 1. 
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seed 

The BMC {X, P, ^) is not strongly recurrent since the spatially homogeneous BMC 
with m{x) ~ 2 and p{x,x + 1) = 1 — p{x,x — 1) = ^-^-^ for all x £ Z is transient, 
see Example 12.151 Let us first take as the origin o of the corresponding BMC*. 
We show that £^11^(0) = oo. The number of particles which never leave state 1 is 
given by a Galton-Watson process with mean number 2 • 3/4 > 1. And so, with 
positive probability, an infinite number of particles visits state 1. This clearly implies 
Eii/(0) = oo. Eventually, the BMC {X,P,fi) is recurrent, but not strongly recurrent. 
Notice, if o = 1 then we have for the corresponding BMC* that E.xv{l) < oo for all x. 

Remark 2.19. Example 12.181 illustrates very well the idea of seeds that make BMCs 
recurrent: state 1 can be seen as a seed that may create an infinite number of particles 
without help from outside. Since in this case the seed is just a local inhomogeneity, 
the process may escape the seed and is not strongly recurrent. 

3 Criteria for strong recurrence 

In this section we discuss criteria for strong recurrence of BMC. In Subsection 13. II we 
present known and new conditions for general Markov chains and offspring distribu- 
tions. While Theorem 13.21 of [18| is more of theoretical interest the Lemma 13.41 and 
Proposition 13.61 are new useful tools to prove strong recurrence. In particular, if the 
underlying Markov chain and the offspring distributions are homogeneous, recurrence 
and strong recurrence coincide, compare with Subsection 13.21 

In Subsection 13.31 we present several approaches in order to develop sufficient and 
necessary conditions for strong recurrence for general BMC, see LemmajOSl Theorem 
I3.14[ and Lemma 13.171 An interesting observation is that transience / recurrence 
depend on local properties and recurrence / strong recurrence on global properties 
of the process. Therefore a classification result would demand a suitable description 
of infinite structures and would deliver a measure for inhomogeneity of the process. 
The conditions for strong recurrence are given in terms of appropriate spectral radii. 
While a general and applicable criterion for strong recurrence remains challenging, 
our condition work well in concrete situations, e.g. compare with Theorem 13.151 and 
Example 13.261 The section ends with a short discussion including conjectures in 
Subsection 13.41 

3.1 General Criteria 

The criteria for transience and recurrence, see Theorems 12 . 1 II and 12 . 1 2[ do not depend 
on the precise structure of the branching mechanism but only on the mean offspring 
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m. This can no longer hold true for criteria for strong recurrence since we can choose 
the branching distribution such that with positive probability no branching occurs at 
all, see the following Example 13.11 

Example 3.1. Consider the random walk on Z with drift to the right, i.e., p{x,x+l) = 
1 — p{x, X — 1) = p > 1/2 Va: € Z. In order to construct a nontrivial BMC where with 
positive probability no branching occurs, i.e., P{T]{n) = 1 Vn > 1) > 0, we first 
investigate the underlying random walk. We know. Law of Large Numbers, that 
Sn/n ^ s := 2p — 1 as n ^ oo. Hence for each realization Sni^j) of the random walk 
there exists some T{lo) such that 5„(a;) > (s — s)n for all n > T{lo) for some small 
e > 0. Define 

oo 

Ct := {i^ ■■ Sn{uj) > (s - e)n Vn > T} and := [j Ct- 

T=l 

Due to the Law of Large Numbers and since the Ct are increasing, we have 1 = 
P(Coo) = limT-.oo P(Ct). Hence, there exists some T > such that P{A) > 0, with 
A := {uj : Sn{(^) > (s — e)n Vn > T}. Now we choose the branching distributions 
such that on the event A with positive probability no branching occurs. We define 
if^i^))x<£Z, such that in{x) — m > 1/ p{P) and ^i(a;) = 1 — e~^^ for a: > 0, and 
/ii(a;) = (1 — e^^) for a; < 0, where 6 is some positive constant. Eventually, 

oo 

P(r/(n) = 1 Vn > l\A) > (l - e-^f H " ^-b(s-e)n\^ > g 

and the BMC [X, P, ^) is not strongly recurrent but recurrent since m > 1/ p{P). On 
the other hand if il{x) = jl with m > 1/ p{P) and hence is homogeneous, then the 
BMC {X,P,il) is strongly recurrent, compare with Subsection 13.21 

Despite the above discussion, there exists a sufficient and necessary condition for 
strong recurrence where the offspring distribution may depend on the states. Let 

oo 

fc=i 

be the generating function of fi{x). We have the following necessary and sufficient 
condition for strong recurrence of [18]. 

Theorem 3.2. The BMC {X, P, p.) is not strongly recurrent if and only if there exists 
a finite subset M of X and a function < g < 1, such that 

* (x, Pg{x)) > g{x) Vx i M (3.1) 

and 

3yiM : g{y) > maxg{x). (3.2) 
Proof. We give a sketch of the proof in p2]. We start the BMC in y and define 

■q{n) 
i=l 
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Furthermore, let 

T :— min{3i G {1, . . . , T]{n)} : Xi{n) G M} 

n>0 

be the entrance time in M. It turns out that 

Q{n) g(nAT) 

is a submartingal for n > 0. Since Q(fT.) is bounded, it converges a.s. and in L^. Hence 
there exists some random variable Qoo such that 

Qoo = lim Q{n) 

n — *oo 

and 

EyQoo = lim EyQ{n) > EyQ{Q) = g{y). (3.3) 

n^oo 

Assuming that the BMC is strongly recurrent, we obtain that t < oo a.s. and therefore 
Qoo < inaxa;gM This contradicts inequality l|3.3p since g{y) > uiaxx^M gix). The 
converse is more constructive. Assume the BMC not to be strongly recurrent and 
consider the probability that starting the BMC in x no particles hits some o G X : 

g{x) := P^: (Vn > Vi = 1, . . . , ri{n) : Xi(n) ^ o) for x ^ o 

and g{o) :— 0. One easily checks that g verifies the requested conditions for M := 
{o}. □ 

The conditions in Theorem 13.21 are difficult to check. We did not find a more 
explicit formulation. Furthermore, it is not clear if strong recurrence depends on the 
whole structure of the branching distributions, since the above conditions are written 
in term of the generating function of /i. Nevertheless, we see in Subsection 13.21 that 
in homogenous cases the necessary and sufficient condition for strong recurrence does 
only depend on the mean offspring m{x) and conjecture that this fact holds in general, 
see Conjecture 13.291 

Remark 3.3. Theorem 13.21 implies in particular that strong recurrence depends on 
global properties of the BMC since local properties can be excluded by the choice of 
the finite set M. 

A useful tool are induced Markov chains that couple a Markov chain to the branch- 
ing Markov chain. The induced Markov chain X„ is defined inductively. We can think 
of it as the position of a label. The BMC starts, at time n = 0, with one particle 
that is labelled. At time n the labelled particle picks at random one of its offspring 
and hand over the label. It is easy to check that the position of the label defines a 
Markov chain with transition probabilities P. Another way to interpret the induced 
Markov chain is to modify the original process in a way that particles do not die but 
produce offspring with distribution = fii, i> 1. In this case we can speak of the 
trace of a particle which has the same distribution as the trace of a Markov chain with 
transition kernel P. 

The next Lemma is our main tool to show strong recurrence. 
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Lemma 3.4. Let c > and define C := {a(a;) > c}. // the set C is recurrent with 
respect to the Markov chain {X,P), i.e., is a.s. hit infinitely often by the trace of the 
Markov chain, the BMC is strongly recurrent. 

Proof. The idea is to define a sequence of embedded supercritical Galton- Watson 
processes and show that at least one of them survives. We start the process with 
X = Xi G C. Let us define the first Galton- Watson process (Ci^^)i>o- To this end, let 
be the particles that are the first particles in their ancestry line to return to x 
before time k (to be chosen later) and define '^i inductively as the number of particles 
that have an ancestor in and are the first in the ancestry fine of this ancestor to 
return to x in at most k time steps. Clearly Cq^^ :— 1 and cl^^ := * ^ 1; defines 
a Galton- Watson process. Due to the definition of the process BMC* we have that 
EC['^ =E,r,{k,x). 

Claim: There is some k such that E(^[^^ > 1 and that the probability of survival of 
(Ci^')i>o is larger than c/2. 

We choose k such that the probability of survival of {Cl^^)i>o is larger than c/2. 
If this first Galton- Watson process dies out we wait until the induced Markov chain 
hits a point X2 & C; this happens with probability one since C is recurrent w.r.t 

(2) 

the induced Markov chain. Then we start a second process (Q )i>o, defined in the 
same way as the first but started in position X2. If the second process dies out, we 
construct a third one, and so on. We obtain a sequence of independent Galton- Watson 
processes ( (Ci"'^)i>o) ■ The probability that all these processes die out is less than 

njli(l ~ — 0- Eventually, at least one process survives and we have a{x) = 1 for 
all X e X. 

It remains to prove the claim. Consider the Galton- Watson process (Zi)i>o con- 
structed as (Cj-^^)i>o but with k = co. Hence EZi = Exi^ix) e (0, oo]. Let /(s) = 
SjliMj*"'' < 1 be the generation function of {Zi)i>o. Prom the definition of / 
as a power series with nonnegative coefficients, we have that it is strictly convex 
and increasing in [0,1). Furthermore, the extinction probability q of {Zi)i>Q is the 
smallest nonnegative root of the equation t = fit). For every k we define a process 
{Z^)i>o with corresponding mean offspring ry(fc, x), distribution /z*^ = (^i , ■ ■ 
generating function f''. The probabilities ^'^ converge pointwise to ^ and so do the 
generating functions. Using the fact that f{q) = q and 1 — g > c we find a k such that 
f^{\ — c/2) < 1 — c/2, thus {Z^)i>o survives with probability at least c/2. □ 

Remark 3.5. In Lemma lSTil we can replace the condition that C is recurrent w.r.t. the 
Markov chain by the condition that C is recurrent w.r.t. the BMC, i.e., C is visited 
infinitely often by some particles of the BMC. 

Let F{x) denote the return probability of the Markov chain (X, P), i.e., the prob- 
ability that the Markov chain started in x returns to x. If we assume the branching 
distributions to be constant, i.e., fi{x) = fi for all a: G X, we have the following suf- 
ficient condition for strong recurrence in terms of the mean offspring and the return 
probability of the underlying Markov chain. 
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Proposition 3.6. The BMC {X,P,fj,) with constant offspring distribution is strongly 
recurrent if 

1 

m > sup — -. 

Proof. Due to Lemma [33] we have to show that a{x) > c for all x € X and some 
c > 0. Consider the Galton- Watson process (^i)i>o with offspring distribution ^ and 
mean m. Furthermore, let p such that 

— < p < mi F(x) 
m xex 

and percolate the process (^i)i>o with survival parameter p. This leads to a Galton- 
Watson process (^i)i>o with mean mp > 1 and some survival probability c > 0, 
compare with [H]. Back on BMC, we start the process (X, P, /i) with one particle 
in some arbitrary position, say o, and compare the original process with the BMC 
{X,P,jl) with fewer particles: /i(o) :— fj.{o) and fii{x) := 1 for all x o. In other 
words, (X, P, p,) does only branch in o. Observe that the number of particles returning 
to o in this process can be described by dint of a percolated Galton- Watson process 
(Ci)«>o with offspring distribution /i and survival parameter F(o). Since F{o) < p we 
can use a standard coupling of BernouUi percolation, compare with Chapter 4 in [15] . 
to prove that the survival probability of (Ci)i>o is at least the one of {^i)i>o- If (Ci)j>o 
survives, an infinite number of particles visits o in {X,P,jl) and hence in {X,P,fi) as 
well. We can conclude that a(o) > c for the original BMC {X, P, /i). □ 



3.2 Homogeneous BMC 

Lemma 13.41 offers a general argument to show strong recurrence. In particular, it 
is used to prove that homogeneous BMC are strong recurrent if and only if they 
are recurrent. This fact is also plausible from the viewpoint of seeds. An infinite 
number of seeds are visited and each of these gives birth to a supercritical multi-type 
Galton- Watson process with extinction probability bounded from below. We give 
several known (|3.2.1l[3^T3|) and new l|3.2.2l[3^T4| and l3.2.5|) examples of homogeneous 
processes. They are all consequences of Theorem 12. 121 and Lemma [331 



3.2.1 Quasi-transitive BMC 

Let X be a locally finite, connected graph with discrete metric d. An automorphism 
of X is a self-isometry of X with respect to d, and AUT{X) is the group of all 
automorphisms of X. Recall that when a group T acts on a set X, this process is 
called a group action: it permutes the elements of X. The group orbit of an element 
X is defined as Tx := {7a; : 7 e F}. A group F acts transitivly on X if it possesses 
only a single group orbit, i.e., for every pair of elements x and y of X, there is a group 
element 7 £ F such that jx — y. The graph X is called transitive if AUT{X) acts 
transitively on X, and quasi-transitive if AUT{X) acts with a finite number of orbits. 
Let P be the transition matrix of an irreducible random walk on X and AUT{X, P) 
be the group of all 7 € AUT{X) which satisfy p{'^x, jy) — p{x, y) for all x,y G X. We 



16 



say the Markov chain {X, P) is transitive if the group AUT{X, P) acts transitively on 
X and quasi-transitive if AUT{X, P) acts with a finite number of orbits on X. 

The definition of quasi-transitivity can be extended to BMC. We say a BMC is 
quasi-transitive if the group AUT{X,P,^) of all 7 G AUT{X, P) which satisfy (x) = 
fik iix) Vfc > 1 for all X G X acts with a finite number of orbits on X. Observing that 
a{x) attains only a finite number of values and hence a{x) > c for some c > we 
obtain due to Theorem 12.121 and Lemma [33] the following result. It is due to [I^ and 
also generaHzes some results of [26] . 

Theorem 3.7. Let {X, P, /i) be a quasi-transitive BMC with constant mean offspring 
m{x) — m > 1. It holds that 

• the BMC is transient (a = 0) if m < l/p{P). 

• the BMC is strongly recurrent (a = 1) if m > l/p{P). 

3.2.2 Branching random walk on trees with finitely many cone types 

An important class of homogeneous trees are periodic trees that are also known as 
trees with finitely many cone types, compare with \15\ and j22j . These trees arise as 
the directed cover (based on r) of some finite connected directed graph G : the tree T 
has as vertices the finite paths in G, i.e., (r, zi, . . . , We join two vertices in T by 
an edge if one path is an extension by one vertex of the other. The cone at a; G T 
is the subtree of T rooted at x and spannend by all vertices y such that x lies on the 
geodesic from r to y. We say that and have the same cone type if they are 
isomorphic as rooted trees and every cone type corresponds in a natural way to some 
vertex in G. Let r(x) be the function that maps a vertex x G T to its cone type in G. 
If G is strongly connected, i.e., for every pair x, y there is a directed path in G from x 
to y, we call the cone types irreducible. In this case every cone contains every other 
cone type as a subtree. 

We consider the nearest neighbour random walk on T according to [22]. Suppose 
we are given transition probabilities q{i,j)ij^G on G. We may hereby assume, w.l.o.g., 
that q{i,j) > if and only if there is an edge from i to j in G. Furthermore, suppose 
we are given backward probabilities p{—i) S (0, 1) for each i £ G. Then the random 
walk on the tree T is defined through the following transition probabilities p{x,y), 
where x,y T: 



where x is the ancestor of x. It's worth to mention, that if the cone type are ir- 
reducible, then p{P) < 1 if and only if the random walk is transient, compare with 
Theorem B in [22]. 

Furthermore, we assign branching distributions p, to the vertices of G and define the 
BRW (T, P, p) with p.{x) = ijl(t(x)). We speak of a BRW of finitely many (irreducible) 
cone types and have the following classification: 



p{o,y) q{r,T{y)), if x = y 



and for x ^ o with t(x) 




if X = y 
if y =^ X 
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Theorem 3.8. Let {T,P,fi) be BRW with finitely many irreducible cone types and 
constant mean offspring m{x) = m > 1. It holds that the BMC 

• is transient (a = 0) if m < l/p{P), 

• is strongly recurrent (a — 1) if m > 1/ p{P). 

Proof. First observe that the process is not quasi-transitive and a{x) ^ a{y) for 
t{x) = T{y). We prove that for every cone type a(x) > c{t{x)) > and conclude 
with Theorem 12.121 and Lemma 13.41 Due to Lemma 12.51 there exists a finite subset 
F such that m ■ p{Pf) > 1- Now, since the cone types are irreducible every cone 
contains F as a subset (hereby we mean a subset that is isomorphic to F). We fix 
a cone type say i & G and and let x such that t{x) — i. There exists some n £ N 
such that the ball Bn{x) of radius n around x contains F. Lemma [231 vields that 
p{T^ n Bn{x)) ■ m > 1. Recalling Remark 12.141 we notice that the embedded multi- 
type Galton- Watson process living on Bn(x) is supercritical and survives mit 
positive probability, say c{i). We can conclude with a standard coupling arguments 
that a{x) > c{i) for all t{x) = i. □ 

If the cone types are not irreducible all three phases may occur, compare with 
Theorem EH 

3.2.3 Branching random walk in random environment (BRWRE) 
on Cayley graphs 

Let G be a finitely generated group. Unless G is abelian, we write the group operation 
multiplicatively. Let S" be a finite symmetric generating set of G, i.e., every element of 
G can be expressed as the product of finitely many elements of S and S = . The 
Cayley graph X{G, S) with respect to S has vertex set G, and two vertices x,y £ G 
are joined by an edge if and only if x~^y € 5*. Now, let q be some probability measure 
on S. The random walk on X{G, S) with transition probabilities q is the Markov chain 
with state space X = G and transition probabilities 

p{x, y) = q{x^^y) for x^^y G S 

and otherwise. The discrete convolution is defined as g * q{x) — J2y liy)Q{y~^^)- 
The n-step transition probabilities are 

p<^-\x,y)^q-ix-'y), 

where g" is the n-fold discrete convolution of q with itself. We start the random walk 
at time in some position o & X. 

We introduce the random environment. Let M be the collection of all probability 
measures on S and let {ujx)xex be a collection of iid random variables with values 
in Ai which serve as an environment. For each realization uj :— {uj,j;)x(ex of this 
environment, we define a Markov chain {Xn)nefi on X = G with starting position o 
and 

Vuj,oiXn+i = y\Xn = x) p^{x,y) LVxix^^y) Vn > 1. 
We denote by Puj the transition kernel of the Markov chain on the state space X. 
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Let rj be the distribution of this environment. We assume that 77 is a product 
measure with one-dimensional marginal Q. The support of Q is denoted by K. and its 
convex hull by K.. We always assume the following condition on Q that ensures the 
irreducibility of a random walk with transition probabilities q € ft : 

Q{uj : uj{s) > 7 Vs e 5'} = 1 for some 7 > 0, (3.4) 

where S" C S' is a minimal set of generators, i.e., every proper subset T C S" is not a 
generating set. 

In addition to the environment which determines the random walk we introduce 
a random environment determining the branching mechanism. Let B be the set of 
all infinite positive sequences /i = (Aifc)fc>i satisfying X^fcLi Mfc = 1 f-nd m(/i) := 
SfcLi ^Mfe < Let Q be a probability distribution on B and set 

TO* := sup{TO(/i) : ^ e supp(Q)} (3.5) 

which may take values in M U {00}. Let {lOx)xi^x be a collection of iid random vari- 
ables with values in M and {iJix)xex be a collection of iid random variables with 
values in B such that {uJx)xi^x and {iJix)xi^x are independent, too. Let 8 be the corre- 
sponding product measure with one-dimensional marginal Qx Q. For each realization 
(w,/^) :— (wx,Ma:)xex let Puj be the transition kernel of the underlying Markov chain 
and branching distribution fj,{x) — fix- Thus, each realization (w,/i) defines a BMC 
{X,P^,li). We denote by V^^,^ the corresponding probability measure. 

We assume that to* > 1, excluding the case where the BMC is reduced to a Markov 
chain without branching. 

The classification is due to [lOj where it is proved for BRWRE on Cayley graphs. 
Furthermore, compare to [21] where it is shown for a model where branching and 
movement may be dependent. The interesting fact is that the type only depends on 
some extremal points of the support of the random environment, namely the highest 
mean offspring and the less transient homogeneous random walk. 

We obtain due to Lemma 13.41 and Theorem 12.121 that the spectral radius is deter- 
ministic, i.e., p{Pu) — P for 0-a.a. realizations. This can also be seen directly from 
the observation that p{Pui) — limsup (p(")(a;, x)) ^ does not depend on x and hence 
by ergodicity of the environment is constant a.s. . 

Theorem 3.9. If m* < 1/p then the BRWRE is transient for Q-a.a. realizations 
{ijj.p), otherwise it is strongly recurrent for Q-a.a. realizations {uj,p,). 

In the special case of the lattice the spectral radius p can be calculated explicitly. 

Corollary 3.10. The BRWRE on is strongly recurrent for Q-a.a. realizations if 




Otherwise it is transient for Q-a.a. realizations. 
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3.2.4 BRW on percolation clusters 

Let in this subsection G be a graph with bounded geometry and origin o. We consider 
Bernoulli(p) percolation on G, i.e., for fixed p G [0, 1], each edge is kept with proba- 
bihty p and removed otherwise, independently of the other edges. Denote the random 
subgraph of G that remains by G(w) and C{uj, x) the connected component containing 
X. We refer to Chapter 6 in [15] for more information and references on percolation 
models. 

Theorem 3.11. The BRW with constant offspring distribution and m > 1 and un- 
derlying SRW on a connected component of C{lu) is a.s. strongly recurrent. 

Proof. We start the BRW in o and consider C{uj,o). Clearly if the component is finite 
then the BRW is strongly recurrent. Due to Lemma [2.51 and p{Z) = 1 there exists 
a subset F of Z such that p{Py) • m > 1. W.l.o.g. we can assume F to be a fine 
segment of length k. Now, let us imagine that the percolation is constructed during 
the evolution of the BRW. For n > 1 we denote i?„ = -B„(o) the ball of radius n 
around the origin o. We percolate the edges in the ball Bk. The percolation cluster is 
now defined inductively. If one vertex of the border, say Xi, of the ball Bik is hit by 
some particle we percolate the edges in i?(i+i)fe \ Bik. With positive probability (3{xi) 
we have that G(w, a;i)n(i3(i+i)fc\Bife) equals the line segment of length k. Since G is of 
bounded geometry we have that f}{xi) > 5 > for all Xi. Observe that a{xi) is at least 
the survival probability, say c, of the multi-type Galton- Watson process restricted on 
the line segment of length fc, compare with Remark l2.14l Eventually, either C(lu,o) is 
finite or the set {a{x) > c ■ 6} is recurrent w.r.t. the BRW and we can conclude with 
Remark [331 □ 

3.2.5 Uniform BMC 

Let us assume that (p*^'^ (x, x))^/' converges uniformly in x, i.e., W e > 3 I such that 
(p^'^(a;, a;))^/' > p{P)—eyx e X, and that there is a A: g N such that inf^^ '^l^ii^) ^ 
l/p{P). Now, consider a modified BMC with branching distributions 

oo 

jjLoix) = Pi{x) and jli{x) = p,i{x) for i = 1, . . . ,k and x £ X. 

i=k+l 

For this new process we obtain a sequence of supercritical Galton- Watson processes 
((Ci"'^)i>i)i>i with bounded variances and means bounded away from 1, since I and 
k do not depend on the starting position sj. Observe that we have for the generating 
function / of a Galton Watson process with mean m and variance that /'(I) = m 
and /"(I) = tJ^/ (m — m?). The extinction probability q of a Galton- Watson process is 
the unique nonnegative solution less than 1 of the equation s = f{s). Using Taylor's 
Theorem and the convexity of /' we can conclude that the extinction probabilities qj 
of (Ci"''')i>i are bounded away from 1. 

3.3 Inhomogeneous BMC 

In this section we give conditions for strong recurrence, a = 1, and recurrence, a < 
1, that, although failing to produce a complete classification, work well in concrete 
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examples. We assume throughout this section that ii{x) — n for all x Q X. 



3.3.1 Connecting Markov chains at a common root 

We present a method to glue different Markov chains following Chapter 9 in [29] . Let 
{Xi, Pi), z S /, be a family of irreducible Markov chains. We choose a root in each 
Xi and connect the Xi by identifying all these roots. The rest of the Xi remains 
disjoint. This gives a set X = IJ^ Xi with root r, {r} = f]^ Xi. In order to define the 
transition matrix P on X, we choose constants > such that a; = 1 and set 



Pi{x,v) x,y e X„ X ^ r, 

a,p^{r, y) x = r, y e X^ \ {r}, 

X;iazPj(r-,r) x ^ y ^ r, 

otherwise. 



When each Xi is a graph and Pi is the SRW on Xi, then X is the graph obtained 
by connecting the Xi at a common root r. Choosing ai — degxi{r)/degx{r), we obtain 
the SRW on X. Due to this construction the calculation of the spectral radius of {X, P) 
can be done with the help of generating functions of {Xi, Pi), compare with Chapter 
9 in [29]. 

For these types of Markov chains we obtain a condition for strong recurrence in 
terms of 

e(P) :=inf p(PO e [0,1]. (3.7) 

Lemma 3.12. Let {Xi, Pi), i ^ I , he a family of irreducible Markov chains and {X, P) 
as defined in 113.6]) . The BMC {X,P,fi) with constant branching distribution is not 
strongly recurrent, i.e., a < 1, if 

m < 1/q{P). 

If the inf is attained then m — 1/ g{P) implies a < 1, too. 



Proof. There exists i € I such that m < 1/ p{Pi). Due to Theorem 12. 121 we know that 
the BMC {Xi,Pi,fi) is transient. Hence, there exists some x & Xi such that the BMC 
{Xi,Pi,p,) started in x never hits ri — r with positive probability. Therefore, with 
positive probability the BMC {X, P, started in x never hits r. □ 

Remark 3.13. If m = 1/ q{P) and the infig/p(Pi) is not attained then both cases can 
occur. The BMC is strongly recurrent if all {Xi, Pi) are quasi-transitive, compare with 
Theorem 13.141 In order to construct an example that is not strongly recurrent, let 
{Xi, Pi) be as in Example l2.18l For z > 2, let {Xi, Pi) be the random walk on Z with 
drift defined hy pi{x , x + 1) ~ '^^/^ — We glue the Markov chains in r = = 
and obtain g{P) — |. Since the BMC {Xi,Pi,y) with to = 2 is not strongly recurrent, 
this follows for the BMC {X, P, ^) as well. 

For certain Markov chains, constructed as above, we can give a complete classifi- 
cation in transience, recurrence and strong recurrence. Observe that we can replace 
quasi-transitive by any other homogeneous process of Subsection 13.21 Interesting is 
the subtle behavior in the second critical value; the BMC may be strongly recurrent 
or weakly recurrent. 
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Theorem 3.14. Let {Xi,Pi),i g /, be a family of quasi-transitive irreducible Markov 
chains and {X, P) as defined in ^3.6]) . We have the following classification for the 
BMC {X, P, ^) with constant mean offspring m : 

(i) m <l/p{P) a = 0, 

(m) IMP) < m <l/g{P) < a(a;) < 1, (3.8) 

(Hi) 1/ q{P) < 771 a = 1. 

If the inf in the definition of g{P) is attained, then m = l/g{P) implies a < 1, 
and if the inf is not attained, then m — 1/ g{P) implies that a = 1. 

Proof. The part (i) is Theorem 12.121 (ii) is Lemma [3 . 1 21 and (Hi) follows from The- 
orem [3?7| by observing that each BMC {Xi,Pi,iJ,) is strongly recurrent. The same 
argumentation holds if the inf is not attained. The case when the inf is attained 
follows with Lemma [3. 121 □ 

Analogous arguments yield the classification for trees with finitely many cone types 
that are not necessarily irreducible. For this purpose let Gi be the irreducible classes 
of G, Ti the directed cover of d, and p(T) := min; p{Ti). 

Theorem 3.15. Let {T,P,fi) be a BRW with finitely many cone types and constant 
mean offspring m{x) — m > 1. We have 

(i) a^Oifm< l/p{P), 

(a) < a < 1 if l/p{P) < 777 < l/p(P), 

(Hi) a = 1 if m > l/p{P). 

Remark 3.16. The example in Theorem 13. 151 illustrates very well the two exponential 
effects that compete. The first is the exponential decay of the return probabilities 
represented by p{Pi) and the other the exponential growth of the particles represented 
by 777. If 777, is smaher that 1/ p{Pi) for ah i the decay of the return probabilities 
always wins and the process is transient. In the middle regime where 1/ p{Pi) < m < 
1/ p{Pj) for some i,j the exponential growth may win but if 777. > l/p{Pi) for all i the 
exponential growth always wins and the process is strongly recurrent. 



3.3.2 Simple random walks on graphs 

In order to find conditions for strong recurrence we inverse the action of connecting 
graphs at a common root and split up some given graph in appropriate subgraphs. In 
the remaining part of this section we assume for sake of simplicity the Markov chain 
to be a simple random walk on a graph G — (y,E), where V — X is the vertex set 
and E is the set of edges. Keeping in mind that p{P) — sup^p^^^ p{Pf) , compare 
with equation l|2.2p . we define 

p(P):= iiif p{Pf), 

\dF\<oc 

where the inf is over ah infinite irreducible F C X such that the (inner) boundary of 
F, dF := {x G F : X ^ F'^} is a finite set. We associate a subset F C X with the 
induced subgraph F C G that has vertex set F and contains all the edges xy e E 



22 



with x,y £ F. We can express p(P) in terms of transient SRWs on induced subgraphs 
with \dF\ < oo. For such a graph F we obtain 

p''p\x,y) = ¥,{X„ = y,X,eFyt<n) 

= Px{Xn ^ y\X^ e F\/i<n)- ¥^{X, £ F \/i < n) 
= q'^"\x,y)-]P4X,e Fyi<n), 

where q^"-' (x, y) are the nth step probabiHties of the SRW on F with transition kernel 
Q. Since F is transient and dF is finite, we have for a; G \ dF that 

V4X, e F Vi < n) > F^{Xi e F Vz) > 

and hence 

Hmsup ( (x, y) j = limsup I (/^"^(x, j/) j , \/x,y £ F. 
Eventually, we can write 



p(P)-p(G)= inf 
iai="l<oo 

where the inf is over all induced connected infinite subgraphs F <Z G with finite 
boundaries. In analogy to the proof of Lemma [3.121 we obtain a necessary condition 
for strong recurrence that we conjecture to be sufficient for graphs with bounded 
degrees. 

Lemma 3.17. The BMC (G,^) is not strongly recurrent, a < 1, if 

1 



m < 



KG)- 

If the inf is attained then m = \/p(G) implies a <1. 

Remark 3.18. Lemma [3.171 holds true for any locally finite graph. However, m > 
l/p{P) does not imply strong recurrence in general, see the following Example 13.191 
and Subsection [33] for a more detailed discussion. 



Example 3.19. Consider the following tree T with exploding degrees bearing copies 
of Z+ on each vertex. Let r be the root with degree 7. First, define inductively the 
skeleton of our tree: deg{x) — 2^"+"^ — 1 for vertices x with d{r, x) — n. Now, glue on 
each vertex a copy of Z+, such that in the final tree a vertex with distance n from 
the root has degree 2^""'"'^ or 2. Due to this construction we have p{T) = p{T) = 1. 
Consider the BRW (T, ^) with p2{x) = 1 for all x £T and start the process with one 
particle in r. The probability that no copy of Z+ is visited is at least the probability 
that the process lives only on the skeleton and moves always away from the root: 

^ n— 1 ^ ^ 

Hence the BRW is not strongly recurrent. 
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In order to give a sufficient condition for strong recurrence we define 



p{P) := limsup inf p{Pb,Ax)) (3.9) 

and write p{G) for the SRW on G. Here, Bn{x) is the ball of radius n around x. 
Notice that this can be seen as a variation of of the spectral radius since 

p{P) = limsup sup p(Pb„(^)). 

Proposition 3.20. Let G be a graph with bounded geometry. The BRW (G, /i) with 
constant offspring distribution is strongly recurrent if 

1 

m > 



piG)' 



Proof. There exists some n e N such that for all x S X we have m > 1/p{Pb^(x))- 
We follow the lines of the proof of Theorem 13.71 and construct and infinite number of 
supercritical Galton- Watson processes. Observe that since the maximal degree of G is 
bounded, there are only a finite number of different possibilities for the graphs i?x,n- 
Therefore, the extinction probabilities of the Galton- Watson processes are bounded 
away from 1 and and we can conclude with Lemma [3741 □ 



Remark 3.21. The sufficient condition in Proposition I3.2QI is not necessary for strong 
recurrence in general. Consider the following tree T that is a combination of T3 and 
Z : Let r be the root with degree 2. The tree T is defined such that deg{x) = 3 
for all X such that d{r,x) € \^'2k ^2'^'^+^ — l] and deg{x) — 2 for all x such that 
d{r,x) e [22^+1, 22'=+2 - 1] for /c > 0. We have p{T) = 1, p{T) = ^(¥3) = 2%/2/3 < 1 
and that the BRW (T, p) is strongly recurrent for all m > 1. To see the latter observe 
that for all TO > 1 there exists some k such that ^^'^■'(0, 0) • m'^ > 1, where Pz is the 
transition kernel of the SRW on Z. Thus each part of Z of length k constitutes a seed 
and we conclude with Lemma [331 



3.3.3 Simple random walks on trees 

Let T be a tree of degree bounded by Af g N and denote Pt for the transition matrix 
of the SRW on T and Pta/ for the transition matrix for the SRW on Tm, the M- regular 
tree. We consider T to be an infinite subtree of Tm. One shows by induction on n : 

Lemma 3.22. 



Since the spectral radius of the SRW on Tm is p{Tm) — ^^m~"^ ; compare with 
Example 12.171 we immediately obtain a lower bound for the spectral radius of SRW 
on trees with bounded degrees. 

Lemma 3.23. Let T be a tree with degrees bounded by M. Then the simple random 
walk on T satisfies 

2VM^ 
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We obtain the following Corollary of Lemma 13.231 and Proposition 13.201 



Corollary 3.24. Let T be a tree with maximal degree M. The BRW (T,iJ,) with 
constant offspring distribution is strongly recurrent if m > '^^^j''^ ■ 



Remark 3.25. Observe that Lemma [3.231 does hold for general graphs with degrees 
bounded by M, compare with Theorem 11.1 in }29] . Therefore, Corollary 13.241 does 
hold true for graphs with degrees bounded by M as well. 

We conclude this chapter with an interesting and illustrative example, gathered 
from [29] (Chapter 9), where we can give a complete classification in transience, re- 
currence and strong recurrence. 

Example 3.26. We construct a graph that looks like 
a rooted M-ary tree with a hair of length 2 at the 
root. Let Gi be the tree where each vertex has degree 
Af > 1, with the exception of the root o, which has 
degree A/— 1. As G2 we choose the finite path [0, 1,2]. 
The graph G is obtained by identifying with o, 
compare with Subsection 13.3.11 The SRW on G is 
obtained by setting ax ~ and a2 — jj, compare 
with Equation l|3.6p . Let us first consider the case 



1 seed 



where Af > 5. One calculates the spectral radius of 
the SRW on G : 




p{G) 



I M -1 
2{M - 2) 



Recall that g{G) = min{p(Gi), p(G2)}. Due to Lemma [3?23l we have g{G) > "^^^ ^ 
Since p(Gi) = we have g{G) = ■ Notice that g{G) = p{G) = /5(G). 

Now, Theorem 12. 12^ Lemma [3. 121 and the proof of Theorem 13. 141 yields 

(i) m < 1/ p{G) {G,^) is transient, 

(ii) l/p{G) <m< l/g{G) =^ (G, /i) is recurrent, 

(iii) m > l/g{G) =^ {G,p) is strongly recurrent. 

Observe that in this example the graph G2 can be seen as a seed that makes the 
BRW recurrent. The first critical value l/p{G) is such that the G2 becomes a seed, 
where the second critical value l/g{G) is such that the branching compensates the 
drift induced by the graph Gi. Furthermore, notice that for M = 3,4 the spectral 
radius of G is p(G) = ^^^g^ and recurrence and strong recurrence coincide. Thus in 
this case, the branching which is necessary to produce a seed in G2 must be at least 
as high as the branching that is needed to compensate the drift of the SRW on Gi . 



3.4 Outlook 

We know that if the off'spring distributions depend on the state, any criterion for strong 
recurrence must incorporate more information on the offspring distributions than the 
mean. If the offspring distributions do not depend on the state, we conjecture, compare 
with the results obtained Section O that there is a second threshold: 
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Conjecture 3.27. Let {X, P, /i) be a BMC with constant offspring distribution. Then 
there exists some fh such that the BMC is strongly recurrent ifm>m and not strongly 
recurrent if m < fh. 

Let us state the conjecture made in Subsection 13.3.21 Recall 

p(G)= inf p{F), 

\dF\<oo 

where the inf is over all induced connected infinite subgraphs F C G with finite 
boundaries. 

Conjecture 3.28. Let G be a graph with bounded degrees. The BRW {G, ^) with 
constant offspring distribution is strongly recurrent if 

1 

TO > 



KG) 

For SRWs on locally finite graphs this is not true, compare with Example 13.191 
This example suggests to consider transient subsets. Let 

p{G,m) -.^MpiF), 

where the inf is over all irreducible F C G where dF is transient with respect to the 
BRW {F,p.). Observe that p{G,m) does depend on to since transience is w.r.t. the 
BRW. In analogy to the proof of Lemma 13.171 we can prove that the BRW (G, p) is 
not strongly recurrent if to < l/p(G, m). We conjecture that for BRWs l/p{G,m) is 
decisive for strong recurrence, compare with Lemma [3. 171 

Conjecture 3.29. Let G be a graph. The BRW {G, p) with constant offspring distri- 
bution is strongly recurrent if 

1 

TO > 



p{G,m)' 



4 Positive recurrence 



An irreducible Markov chain is called positive recurrent if the expected time to return 
is finite for all possible starting positions. We generalize this definition to BMC and 
say the process returns to its starting position if the starting position is hit by at 
least one particle. If the expected time to return is finite, we call the BMC positive 
recurrent. 

Definition 4.1. A recurrent BMC is positive recurrent if 

E^T^ < oo \fxeX, (4.1) 

with Tx := inf{n > : 3i £ {1, 2, . . . , r]{n)} : Xi{n) = x}. Otherwise it is called null 
recurrent. 

In contrast to the question of transience and recurrence of BMC, it is now also 
interesting to consider underlying null recurrent Markov chains and ask whether the 
corresponding BMC is null or positive recurrent. For a Markov chain we have that 
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either 'E.xTx < oo for all or for none x ^ X. This does no longer hold for BMCs, as we 
can see in the following Example 14.21 Furthermore, positive recurrence does depend 
on more information of the offspring distribution then just the mean offspring. 

Example 4.2. We consider a random walk on a 
directed graph with denumerable many directed 
cycles of exploding length emanating from the ori- 



gin o. Let Ci = (cj,'\ 



Si) 



T with 



-0 



) be cycles of length 
= o for i > 1. The origin o 



is the only common vertex of these cycles, i.e., 
^ cp\ for 1 < fc < 2^ and 1 < Z < 2^ Vi, j € 
N. The transition probabilities P era. X :— IJ^ Ci 
are defined as 




p(o, c\ 



1 vl<fc<2^ z>i. 

The Markov chain {X, P) is null recurrent. We consider the BMC {X, P, /i) with 
/zi(o) = H3{o) = ^ and ^2(2;) = 1 Va: ^ o. It is now straightforward to show that 
EqTo = 00 but E (i)T (i) < 00. Observe that the BMC with the same constant mean 
offspring m — 2 but fJ.2{x) — 1 for all x e X is positive recurrent, i.e., ExTx < 00 for 
all X e X. 

Despite Example 14.21 we have under some natural assumptions on the branching 
that ^xTx < 00 holds either for all or none x X. 

Lemma 4.3. Let (X, P, /i) be a BMC and assume that < Ijli{x) < 1 for all x ^ X. 

If EqTo < 00 for some o E X we have 

'ExTy < 00 \fx, y <E X. 

Proof. We start the BMC in o. Let y ^ X and choose k such that p^''^ (o, y) > 0. Since 
fj,i{x) > Vx we have that with positive probability the total number of particles at 
time fc is 1 and that this particle is in y, i.e., rj{k) = ri{k,y) = 1. Hence, EjjTo < 00. 
In order to show EqTj, < 00 we use that /ii(a:) < 1. Let Ti be independent random 
variables distributed like To under Po[-|r?(l) = 1]. We proceed with a geometric waiting 
time argument: We start the process with one particle in o and wait a random time 
Ti until a first particle returns. This particle splits up in at least two particles with 
positive probability 1 — /ii(o). One of these particles starts a new process that returns 
to o after T2 time steps. The remaining particles, if there exists any, hit y after k 
time steps with positive probability at least p^^\x,y). This is repeated until y is hit. 
Therefore, we obtain with g := (1 — ^i{o))p'^''\o,y) : 



i> 1, 



E, 



00 / * \ 



i=l 



since Exi — Ko[To\ri{l) = 1] < cx3. Hence, EoTy < 00 and E^Tq < 00 for all y E X. 
Since ^xTy < E^^Tq + E^Ty \/x, y E X we are done. □ 
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There is a branching analog to the 2nd criterion of Foster, compare with Theorem 
2.2.3. in p], for positive recurrence of Markov chains. 

Theorem 4.4. Let o <E X. If there exists a nonnegative function f with f{o) > such 
that 

f(x) - e 

Pfix) < , , yx^o for some e > 0, (4.2) 
m[x) 

then E,xTo < CG for all x ^ o. 
Proof. Let x ^ o. We define 

ri{n) 

Q{n) 

i=l 

and 

Z{n)■.^Q{n^To)+e■{n^To). (4.3) 

We write LLi[n) :— {xi{n), . . . ,a:^(„)(ri)} for the positions of particles at time n and 
obtain using Equation l|4.2p : 

E^[Q(n + l)|w(n) = < Q{n) - er]{n) 

under {To > n}. Hence, under {To > n} we have 

[Z{n + l)\uj{n) = uj] = [Q(n + 1) + e(n + 1)] 

< Q{n) — er]{n) + e{n + 1) 

< Q{n) + en. 

Therefore, Z(n) is a nonnegative supermartingale. We obtain with Equation (|4.3p 

E.[Z(n)] E,[Z{Q)] fix) 
Ex[^^ A To] < < = . 



Letting n ^ oo yields 



^x[To] < ^ < oo Wx^o. 



□ 



In general it is not possible to give criteria for the positive recurrence in terms 
of the mean offspring m{x), compare with Example 14.21 Despite this fact, it turns 
out that for homogeneous BMC, e.g. quasi-transitive BMC, strong recurrence and 
positive recurrence coincide. We refer to |t6j where the asymptotic of the tail of the 
distributions of the hitting times are studied even for branching random walks in 
random environment. 

In the following subsection, we present another method to show positive recurrence 
of BRW on Z using large deviation estimates and the rate of escape of the BRW. 
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4.1 BRW on Z 



Let us consider an irreducible, transient random walk, S'„ = -^i^ ^ ^iih i.i.d. 

increments Xi. Furthermore, we assume bounded jumps, i.e., \Xi\ < d for some G N. 
This assumption will be crucial in the proof of Lemmata 14.91 and 14.101 but can be 
replaced for Theorem 14.51 and Corollary 14.61 by the assumption that S'„/n satisfies a 
large deviation principle. Without loss of generality we assume that the random walk 
has drift to the right, i.e., E[Xi\ > 0. Let /(•) be the strictly monotone rate function 
defined by 

-I {a) = Hm - logP(S'„ < an) for a < EX,. 

We consider the BMC (X, P, ^) with constant offspring distribution with mean 
offspring m and denote M„ the leftmost particle at time n. 

We haye the well-known result for the minimal position of a BRW, compare with 
d], [I3], 01, mi, and [19] for multi-type BRWs. 

Theorem 4.5. ^ 

liminf — - = sup{s : /(s) > logm} P-a.s. 

n — >QO n 

Since p{P) — e''^'^^\ compare with Lemma [2^ we immediately obtain the follow- 
ing result on the speed of the leftmost particle. 

Corollary 4.6. Let {X,P) he a random walk with hounded jumps on X = 1, and drift 
to the right. For a BRW {X, P, /i) with constant offspring distrihution the following 
holds true: 

(i) Ifm> IMP), then 

liminf < V-a.s. 

n — *oo 77, 

(a) If m = l/p{P), then 

liminf = P-a.s. 

n — >oo 71 

(Hi) If m < l/p{P), then 

liminf— >0 f-a.s.. 

n — >oo 77, 

Remark 4.7. In particular. Corollary 14.61 impHes transience if m < 1/ p{P) and strong 
recurrence if m > 1/ p{P). 

Eyentually, we obtain that under the aboye conditions strong recurrence implies 
positive recurrence: 

Theorem 4.8. Let {X,P) he a random walk with hounded jumps on X — Z and 
drift to the right. The BRW {X, P, fj,) with constant offspring distrihution is positive 
recurrent if m > l/p{P). 

The proof follows from the following Lemmata l4.9l and 14. 101 Beside we consider 
the following stopping time 

:= inf {3i G {1,2, . . .,r]{n)} : Xi{n) g [x - d,x\}. 

n>0 
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Lemma 4.9. Let {X, P) he a random walk with hounded jumps on X = 21 and drift to 
the right. For a BRW {X^P^fi) with constant offspring distribution and m > l/p{P) 
we have 

^xTx < oo Vx e X. 
Proof. We show the claim for a; = and write T for Tq. Since 

ET P(f > n) 

n>0 

it suffices to study the behavior of P(T > n) for large n and to show that it is 
summable. To this end we split the sum into two terms: 



P(T >n) = Yf[T> n\r]{jn) = fc j P ir]{jn) = k) 

k=\ 
oo 

+ X! ¥ [t > n\r]{-in) = k^'F [T][jn) = k) 

A:=An+l 

with A > and 7 € (0, 1) to be chosen later. Here we assume that An and 7/1 take 
values in N. We obtain 

00 

P(f > n) < P (r?(7n) < An) + ^ P (^T > n|?7(7n) = /c) . (4.4) 

fc=Ari+l 

In order to estimate the second summand we observe that at time 7n all particles are 
at worst at position ^nd and obtain 

V{f > tU-in) = k) < P(M(i_^)„ > -7nd)'' 

(1 — 7)n 1^7 



Due to Corollarv 14.61 we have 



n (1 — 7)n 

for some s < 0. Now, we choose 7 such that 

id 
~1^1 

Hence, there exists < 1 with 



> s. 



_ (1 — 7)n 1 — 7 
for sufficiently large n. Therefore, 

P(f > n|77(7n) = k) < 9^ (4.5) 
and the second summand in Equation g31) is bounded by 6l-^("+i)/(l - 6*). 
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It remains to bound the first term in Equation l|4.4p . To do this we do not consider 
the whole BRW but focus on the induced random walk. Denote F„ the number of 
times the labelled particle is not the only offspring of its ancestor. In other words, 
when we think about the process where particles live forever and produce offspring 
according to //^-i = /ii « > 1, then y„ is just the number of offspring of the starting 
particle at time n. Hence, F„ ~ Bin{n,p), where p := X)i^2 /^j 0. Observe that a 
Large Deviation Principle holds for Yn, i.e., P{Yn < an) decays exponentially fast for 
a < p. Due to the definition of Yn we have r]{'yn) > Yjn and obtain with I := 'yn that 

Piviin) < An) < P(Y^n < An) = P{Yi < Xj^H). 

The last term decays exponentially fast for A7~^ < p. Therefore, choosing A < P7, we 
obtain that P {ri{'jn) < An) decays exponentially fast. □ 

Lemma 4.10. Under the assumptions of Lemma \4.9\ we have 

ExTx < oo =^ ^xTx < OO- 

Proof. For simplicity let x = and write T and T for Tq and To, respectively. Analo- 
gous to the proof of Lemma FOl it is proven that EyT < oo Vy G X. We start the BRW 
in and consider the random time n when [—d, 0] is hit for the first time by some par- 
ticle. We pick one particle of those being in [—d, 0] at time ti and consider the BRW 
originating from this particle. Due to the irreducibility, there exists k G N and q > 
such that Vy G [— d, 0] we have 0) > q > for some I < k. Hence, is visited 

by some particle up to time k with probability at least q. If is not hit after k time 
steps we consider a BRW starting in some occupied position in [—d{k + 1), d{k + 1)] 
and wait the random time T2 until [—d, 0] is hit by some particle. This is repeated 
until is hit at the random time W. Since Ea;r < oo for all x G X, there exists some 
C > such that E^f < C Vx E [~d{k + l),d{k + 1)]. We conclude with 

ET<EW < E [(n + k)q + (1 - q)q{Ti + ra + fc) + • • • ] 

OO 

< ^(iC-^A:)(l-g)''~i(7 < oo. 

2=1 

□ 
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